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1 INTRODUCTION 


The  adaptive  line  enhancer  (ALE)  is  an  adaptive  digital  filter  designed  to  separate  its 
input  into  two  components,  one  consisting  primarily  of  any  narrowband  signals  present  in  the 
input  (hence  the  term  “line  enhancer”),  and  the  other  consisting  primarily  of  broadband 
noise,  which  is  always  assumed  present  in  the  input.  A block  diagram  of  the  device  is  shown 
in  figure  1 , where  the  above  components  are  denoted  by  r(k)  and  e(k),  respectively.  Since  the 
detailed  operation  of  the  ALE  has  previously  been  described  [ 1-4] , we  shall  only  summarize 
its  basic  properties  in  this  paper,  and  propose  a model  of  the  filter  which  is  convenient  for 
our  further  analysis. 


The  purpose  of  this  paper  is  to  analyze  the  second-order  output  statistics,  i.e.,  auto- 
correlation function  and  power  spectrum,  of  the  ALE  during  steady-state  operation,  with 
input  samples  consisting  of  weak  narrowband  signals  in  white  Gaussian  noise.  “Steady-state 
operation”  implies  that  the  ALE  has  a stationary  input,  and  has  processed  enough  data  so 
that  all  start-up  transients  have  died  out.  The  only  assumption  made  on  the  spectral  shape  of 
the  narrowband  components  is  that  their  inverse  bandwidths  be  large  with  respect  to  the  fil- 
ter sampling  period  f“*.  The  results  are  expressed  in  terms  of  the  ALE  parameters,  the 

second-order  statistics  of  the  input,  and  the  optimum  (finite-lag)  Wiener  filter  weights  for  the 
problem  at  hand.  It  is  shown  that  the  ALE  output  sequence  r(k)  consists  of  two  uncorrelated 
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components:  one  of  them  corresponding  to  the  Wiener  filtered  input,  and  the  other  being 
the  result  of  passing  the  input  through  a “misadjustment  filter”  whose  properties  are  described. 
The  case  where  the  input  consists  of  a deterministic  sinusoid  in  white  Gaussian  noise  is 
worked  out  as  an  example.  Finally,  a number  of  applications  for  these  results  are  described. 


2 BASIC  PROPERTIES  OF  THE  ALE 

The  block  diagram  of  figure  1 reveals  the  ALE  to  be  a particular  variation  of  an  adap- 
tive noise  canceler  [5] , wherein  the  “reference”  or  “desired”  response  is  merely  the  current 
input  x(k),  and  the  “primary”  input  is  a delayed  version  of  x(k).  The  input  x(k)  is  assumed 
to  be  of  the  form 

x(k)  = s(k)  + n(k),  (1) 

where  s(k)  is,  in  general,  the  sum  of  a number  of  narrowband  components  having  nonoverlap- 
ping power  spectra,  and  n(k)  is  a zero-mean  white  Gaussian  sequence  with  power  which  is 
independent  of  s(k).  In  the  lower  channel,  the  delayed  input  is  passed  through  an  adaptive 
linear  transversal  filter  whose  output  r(k)  is  then  subtracted  from  x(k)  to  form  an  error 
sequence  e(k).  This  error  sequence  is  fed  back  to  adjust  the  filter  weights  Wj(k)  according  to 
the  Widrow-Hoff  LMS  algorithm  [ 5 J , 

Wj(k  + 1 ) = wj(k)  + 2 p e(k)  x(k  - i - A),  i = 0,  1 L-l,  (2) 

where  p is  a constant. 

The  principle  of  operation  is  as  follows  [1,2]:  the  weight  algorithm  in  (2)  adjusts 

the  transversal  filter  weights  so  as  to  minimize  the  mean  error  power  E{e(k)^}.  As  a result 
of  the  delay  A,  the  current  noise  input  n(k  - A)  to  the  filter  in  the  lower  channel  is  independ- 
ent of  the  current  input  x(k)  to  the  ALE.  However,  A is  chosen  to  be  somewhat  less  than 
rmin,  minimuni  correlation  time  constant  of  any  (narrowband)  component  of  s(k),  so 

that  the  current  signal  input  s(k  - A)  to  the  filter  is  highly  correlated  with  the  current  signal 
input  s(k)  to  the  ALE.  The  implicit  strategy  of  the  weight  adjustment  algorithm  is  then  to 
cause  r(k)  to  be  a prediction  of  the  current  value  of  s(k),  based  on  the  data  x(k  - i - A), 
i = 0,  1 , . . . , L - I , so  that  in  subtracting  r(k)  from  x(k),  the  mean  power  in  e(k)  is  mini- 
mized. Thus,  the  filter  weights  will  tend  to  form  a band-pass  transfer  function  about  the 
center  frequencies  of  any  narrowband  input  components,  and  will  pass  relatively  little  power 
at  other  frequencies.  Reference  [3]  details  this  effect  for  the  case  of  multiple  sinusoids  in 
white  noise.  In  the  absence  of  any  correlated  components  in  the  input  x(k),  the  filter  weights 
will  tend  to  zero  (i.e.,  the  filter  tries  to  turn  itself  off),  since  the  mean  error  power  can  only 
be  increased  by  subtracting  a nonzero  filter  output  r(k)  from  the  (uncorrelated)  input  value 
x(k). 

3 STEADY-STATE  IMPULSE  RESPONSE 

The  convergence  behavior  of  the  ALE  weight  vector 
w(k)  = [w0(k)w,(k). , . wL_  j(k)] T 
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under  various  assumptions  has  been  discussed  by  previous  authors  [1,4].  For  purposes  of 
clarity,  we  shall  briefly  discuss  the  assumptions  made  in  our  analysis. 

The  ALE  weight  vector  w(k  + 1 ) at  time  k + 1 may  be  written  from  (2)  as 

w(k  + 1)  = w(k)  + 2m  x(k)  [x(k)  - xT(k)  w(k)] , (3) 


where 


x(k)  A [x(k  - At  x(k  - A - 1) . . . x(k  - A - L + 1)]T 

Taking  the  expectation  of  both  sides  of  (3),  we  have 

E (w(k  + 1)}  = E (w(k)}  + 2 M [E  {x(k)  x(k)}  - E (x(k)  xT(k)  w(k)}  ] . (4) 

Since  w(k)  depends  on  all  of  the  past  data  x(k  - 1 ),  x(k  - 2), . . . , the  last  expectation  in  the 
above  equation  is  not  separable,  and  an  exact  analysis  of  the  convergence  of  E (w(k)} 
becomes  intractable  beyond  this  point.  It  is  clear  from  (3),  however,  that  for  very  small 
values  of  m (relative  to  the  variance  of  x(k)),  the  weight  vector  w(k)  changes  very  slowly  with 
time.  Thus,  in  the  steady-state  circumstances  considered  here,  one  would  expect  little  statis- 
tical dependence  of  the  weight  vector  on  the  relatively  brief  span  of  data  (L  samples)  encom- 
passed by  the  vector  x(k).  This  would  particularly  be  so  in  the  low  signal-to-noise  ratio 
(SNR)  case  of  interest,  since  most  of  the  power  in  x(k)  is  then  due  to  white  noise.  Hence, 
we  make  the  assumption  that  w(k)  is  statistically  independent  of  x(k),  so  that 

E {x(k)  xT(k)  w(k)}  = E (x(k)  xT(k)}  E {w(k)>.  (5) 

Letting  <f>  and  d denote  the  E X L autocorrelation  matrix  and  L X 1 cross-correlation  vector, 
respectively,  with  elements 

^pq  = *x<P  ~ 4)  and  dp  = y>x(p  + A),  o,q  = 0,  1 , . . . , L - 1 , (6) 

where  ^>x(fi)  is  the  autocorrelation  function  of  the  input  x(k),  we  may  then  write  (4)  as 

E (w(k  + 1)}  = E (w(k)}  + 2m  [d  - 4>  E (w(k)}l.  (7) 

It  has  been  shown  in  [5]  and  elsewhere  that  the  above  difference  equation  for 
E (w(k)}  converges  (starting  from  an  arbitrary  initial  value)  as  k -*■  °°  to  w*,  the  optimum 
Wiener  weight  vector  given  by 

w*  = <f>-1  d , (8) 

provided  that  0 < m < *m'ax’  where  ^max  *s  ttie  *argest  eigenvalue  of  the  matrix  4>.  Also,  a 

number  of  authors  [1-5]  have  reported  experimental  evidence  which  supports  the  validity  of 
the  assumption  (5),  leading  to  the  expression  (8).  Hence,  insofar  as  this  assumption  is  valid, 
the  mean  ALE  impulse  response  function  in  steady-state  operation  is  identical  to  the  corres- 
ponding optimum  finite-lag  Wiener  filter  impulse  response. 
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Under  the  assumptions  of  small  p,  low  SNR,  and  white  Gaussian  input  noise,  an 
approximate  expression  for  the  steady-state  covariance  of  the  ALE  weight  vector  w(k)  is 
derived  in  [ 1 1 as 

cov  (w(k)}  = p£minI,  (9) 

where  £mjn  is  the  minimum  mean-squared  error  associated  with  Wiener  filtering  of  the  input, 
and  I is  the  identity  matrix.  * An  expression  for  £mjn  may  be  obtained  from  classical  Wiener 
filter  theory  as 

^min  = E {x(k)2}  - dTw*.  (10) 

In  summary,  the  steady-state  impulse  response  of  the  ALE  is  a very  slowly  varying 
vector  random  process  with  mean  value  w*  as  in  (8),  and  covariance  given  by  *.9)  and  (10). 

By  assuming  a sufficiently  small  value  of  p,  the  weight  vector  may  be  considered  constant 
over  time  intervals  which  are  large  relative  to  the  length  (in  time)  of  the  transversal  filter. 

This  suggests  the  model  shown  in  figure  2 for  the  ALE  structure  during  steady-state  opera- 
tion. The  ALE  weight  vector  w is  decomposed  into  its  mean  value  w*  and  a “misadjustment 
weight  vector”  w,  viz., 

w = w*  + w,  (11) 

where  we  have  dropped  the  time  index,  due  to  the  near-constant  behavior  of  w.  The  Wiener 
weight  vector  w*  is  a deterministic  quantity  given  by  (8),  and  the  misadjustment  weight 
vector  w (so  named  because  it  represents  a random  bias  away  from  w*)  is  a zero-mean  random 
vector,  with  covariance  given  by  (9)  and  (10),  which  is  assumed  statistically  independent  of 
the  current  data  in  the  filter.  Thus,  the  ALE  output  r(k)  is  the  superposition  of  the  Wiener 
filter  (WF)  and  misadjustment  filter  (MF)  outputs  when  excited  by  the  input  x(k).  This 
model  will  prove  convenient  in  the  analysis  of  the  following  section. 

4 SECOND-ORDER  OUTPUT  STATISTICS 

Referring  to  figure  2 and  equation  (11),  the  ALE  output  r(k)  may  be  expressed  math- 
ematically as 

r(k)  = r*(k)  + 7(k),  (12) 


It  has  been  shown  In  / 4/  that  a more  precise  expression  for  cov  \w(kj\  may  be  obtained  for  certain  special  inputs,  in 
particular  that  of  a sinusoid  in  white  noise,  which  is  used  as  an  example  in  section  4.  The  expression  in  f4j  contains 
an  added  term  to  that  in  (9).  However,  we  show  in  the  appendix  that  the  effect  of  this  term  is  of  minor  significance. 
Hence  we  shall  employ  f 9 ) as  the  weight  vector  covariance  throughout  the  main  body  of  the  paper. 
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The  autocorrelation  function  ip*(8)  of  r*(k)  is  given  by 


<p*(8)  = E{r*(k) 

r*(k  + 8)} 

L-l  L-l 

= 12 

w*  w*  E (x(k  - i - A)  x(k  + 8 - p - A) } 

i=0  p=0 

L-l  L-l 

L-l  L-l 

=2  2 

wi*  wp  + i - P)  + ^ ^ v1  w*  w*  6(8  + i 

i=0  p=0 

i=0  p=0 

where  y>s(8)  is  the  autocorrelation  function  of  the  narrowband  input  component,  6(*)  denotes 

the  discrete  Dirac  delta  function,  and  we  have  used  the  hypotheses  of  independence  between 
s(k)  and  n(k)  (equation  (1 ))  and  whiteness  of  the  input  noise.  The  latter  double  summation 
may  be  simplified  by  manipulation  of  the  summing  indices  to  yield 


L-l 

L-l 

L-iei-i 

2 

2»* 

w*  *ps(C  + i ■ 

-p)  + v2 

J wi*wi+|8|’ 

i=0 

p=0 

i=0 

L-l 

L-l 

2 

I Wi 

w*  *s(8  + i - 

-P), 

|8|^L.  (15) 

i=0 

p=0 

In  similar  fashion,  the  autocorrelation  function  7(8)  of7(k)  is  given  by 

7(8)  = E{7(k)7(k  + 8)} 


L-l  L-l 

= ^ ^ [*>s(8  + i - p)  + »>2  5(8  + i - p)]  E{wjWp},  (16) 

i=0  p=0 

where  we  have  used  the  assumption  of  independence  between  the  MF  weights  and  the  data 
in  the  filter.  From  (9),  however, 

EfwjWp}  =n  8(i-p), 


and  thus  (16)  may  be  reduced  to 


Combining  ( 1 5)  and  ( 1 7),  the  autocorrelation  function  ^>r(8)  of  r(k)  is  given  by 


and 


E{r(k)r(k  + 8)} 

L-l  L-l 

L-iei-i 

X £ wi*wP*s<e  + 

i-p)  + M2  V w*  wjViei 

i=0  p=0 

+ P*min  L[vJs(C)  + v2 

6(8)],  |8|  < L-l, 

(18a) 

L-l  L-l 

ZZwi  wp*s(8  + 

i-P)  + #ifmin  LK(01. 

i=0  p=0 

(18b) 

It  is  worthwhile  noting  that  the  first  two  terms  in  equation  (18a)  are  the  result  of 
Wiener  filtering  of  the  input  signal,  while  the  last  term  (which  is  due  to  the  misadjustment 
noise  filtering  of  the  input)  is  a scaled  copy  of  the  input  autocorrelation  function  i/>x(8). 

Thus,  the  average  effect  of  the  misadjustment  noise  in  the  ALE  is  to  produce  an  output  com- 
ponent having  the  same  (scaled)  autocorrelation  function  as  the  input  x(k),  yet  uncorrelated 
with  the  Wiener  filter  output  signal.  Since  /i  £mjn  L < 1 in  most  applications,  this  MF  output 

will  be  greatly  attenuated  with  respect  to  the  input.  This  provides  a further  illustration  of 
the  line  enhancement  property  of  the  ALE,  since  the  MF  output  is  the  only  component  of 
r(k)  which  contains  white  noise. 

The  power  spectrum  Pr(to)  of  r(k)  may  be  obtained  by  direct  Fourier  transformation 
of  *>r(8).  Alternatively,  one  may  obtain  the  respective  power  spectra  P*(co)  and  P(co)  sepa- 
rately as  follows.  Since  the  WF  weight  vector  w*  defines  a discrete  linear  filter,  we  may  com- 
pute its  transfer  function  H (eJu;)  on  the  unit  circle  as  (6,  p.  21  ] 


L-l 

H*(ej°J)=^  w*  e'j^P,  -7r<a)<7 r.  (19) 

p=0 


Then,  the  power  spectrum  P*(co)  is  given  by  [6,  p.  393] 

P*(co)  = |H*(ejw)l2  Px(w),  -*<co<7r,  (20) 

where  Px(co)  is  the  power  spectrum  of  the  input  x(k).  This  latter  quantity  is  the  Fourier 
transform  of  the  input  autocorrelation  function: 


Px(oj)  = ^ [*s(8)  + v2  5(8)]  e-j^6,  = Ps(co)  + v2. 

e=-oo 


(21) 


9 


Hence,  from  (20)  and  (21), 


P*(co)=  |H*(ejco)|2  [Ps(cj)  + »'2],  -jr<cj<7r.  (22) 

The  power  spectrum  P(cu)  may  be  obtained  by  inspection  from  (17)  and  (21).  Combining 
these  two  expressions  we  have 

Pr(co)  = [ |HVW)I2  + M Smin  L]  (Ps(u>)  + v2] . (23) 

Again,  we  observe  that  the  output  of  the  ALE  consists  of  the  Wiener  filtered  input  signal  plus 
an  uncorrelated  component  having  the  same  power  spectrum  (except  for  scaling)  as  the  input. 


5 AN  EXAMPLE 

To  illustrate  the  results  of  the  previous  section,  we  shall  consider  the  case  where  the 
ALE  input  is  given  by 

s(k)  = Asin(wok  + 0),  (24) 


where  A,  cog,  and  6 are  constants.  This  of  course  is  a nonstationary  signal.  However,  with 

the  exception  of  the  Wiener  filter  output  replica  of  s(k),  the  remaining  output  components 
in  r(k)  are  approximately  stationary,  and  thus  we  may  compute  their  stationary  second-order 
output  statistics.  These  results  are  shown  to  be  compatible  with  the  general  case  analyzed 
previously. 


The  WF  weights  for  this  case  are  shown  in  [2,  3]  to  have  the  form  (when  cog  is  several 
multiples  of  ir/L  away  from  zero  or  ir), 


* 2a 

Wj  =—  COSCOqU  + A), 


(25) 


where  A is  the  delay  value  shown  in  figure  1 , and  a*  is  defined  in  terms  of  the  input  SNR, 


A2 

SNRin=7r 

2v 

by 

(y)SNRin 
1 + (y)SNRin 


(26) 


(27) 


Note  that  the  WF  weights  do  not  depend  on  the  input  signal  phase  0,  thus  enabling  the  sta- 
tionary analysis  which  follows. 
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&..C: 


The  expected  value  of  r(k)  is  given  as 


L-l 


E (r(k) } = ^ w*  A sin  [ o>q  (k  - i - A)  + 0 ] . 
i=0 

Substituting  (25)  into  (28)  and  using  trigonometric  identities  yields 


(28) 


a*A 


E {r(k)}  = a A sin  (coq  k + 0)  + — 


L-l 

sin  [cuq  (k-2A)  + 0]^  cos  2cjQi 
=0 


L-l  . 

- cos  [cjq  (k  - 2 A)  + 0]  ^ sin  2cjQi  1 

i=0  J 


(29) 


For  cuqL  > 7 r,  the  second  term  above  is  negligible;  hence 
E (r(k)}  — a*A  sin  (u>g  k + 0). 


(30) 


This  result  is  intuitively  satisfying;  note  from  (27)  that  a*  ^ 1 when  (L/2)  SNRjn  > 1,  and 

thus  the  mean  ALE  output  is  approximately  equal  to  the  sinusoidal  component  present  in 
the  input  when  adequate  SNRjn  exists. 

Let  i£*(k,  m)  be  the  (nonstationary)  autocorrelation  function  of  r*(k)  for  this  exam- 
ple. Then  from  (15), 

*>*(k,k  + £)  = E{r*(k)r*(k  + £)} 

L-l  L-l 

J w*  w*  <ps(k  -i-A,k  + fi-p-A) 
i=0  p=0 

L— |fi|— 1 

= ' ^ wi*  wi>|£|»  |£|  < L - 1,  (31a) 

i=0 

L-l  L-l 

^ w*  Wp«ps(k-i- A.k  + fi-p-A),  |£|  > L,  (31b) 
i=0  p=0 


II 


where  ips(k,  m)  is  the  nonstationary  autocorrelation  function  of  s(k).  Letting  tps  (k,  m)  be 
defined  by 

L-l  L-l 

V>*(k,  m)  = ^ ^ w*  w*  <ps(k  - i - A,  m - p - A),  (3: 

i=0  p=0 

and  substituting  (25)  into  (31a),  we  obtain 


*2  2 

V*(k,  k + 2)  + (L  - |£|)  cos  ojq2 

L 


vp  (k,  k + 2)  = 


cos  aWL  + 1) 

+ 7— sin  coq(L  - |2|)  , 121  < L-l, 

sin  cja  u 

(33a) 


ip- (k,  k + 2),  |2|  >L, 


(33b) 


as  the  autocorrelation  function  r*(k).  Again,  for  coq  L>  jt,  only  the  first  term  within  the 
brackets  is  significant;  hence 

' ^ *2  2 

¥>*  (k,  k + 2)  (L  - |2()  cos  w02,  |2|  < L - 1 , (34a) 

<p*(k,  k + 2)  3f « L 

ip^(k,  k + 2),  |2|  > L.  (34b) 


Now  let  <p(k,  m)  be  the  autocorrelation  function  of7(k).  By  analogy  with  equations  (16)- 
(17),  we  obtain2 

L-l 

$*(k,  k + 2)  = n {min  ^ <ps(k  - i-A,  k + 2-  i-A)  + p $min  v 2 L6(2).  (35) 

i=0 

However,  from  (24)  we  have 

A2 

ips(k,  k + 2)  =—  (cos  coq2  - cos  (2cook  + + 2^)1 » (36) 

and  when  this  expression  is  substituted  into  (35)  and  summed,  the  sum  over  the  nonstation- 
ary second  term  is  negligible  by  comparison  with  the  first.  Hence, 

H £ • A2L 

£(k,  k + 2)  as  Ji(2)  A cos  o)q2  + n £min  v2  L5(2),  (37) 


*3ee  the  appendix  for  a more  precise  expression. 


\ 
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where  the  double  argument  in  the  autocorrelation  function  is  no  longer  needed.  Thus,  from 
equations  (34a,  b)  and  (37),  the  steady-state  ALE  output  autocorrelation  function 
ipf(k,  k + £)  with  a deterministic  sinusoid  plus  white  noise  input  is 


2a  v 


<ps  (k,  k + C)  + — (L  " 1*0  cos  W0C 

L 


<Pr(k,  k + fi)  = < 


+ ^ ^min  L “ T cos  ^0®  + ^ > ICI<L-1, 


* Az 

l^s  (k,  k + fl)  + n |min  L—  cos  cjq8,  |£|  > L. 


(38a) 

(38b) 


This  particular  result  was  first  derived  in  [7] , and  later  in  [8] , by  a direct,  but  somewhat 
tedious,  method.  The  above  equation  verifies  that  for  a sinusoid  in  white  noise,  all  of  the 
ALE  output  components  except  the  Wiener  filtered  signal  output  are  approximately  station- 
ary when  cuq  is  several  multiples  of  ir/L  away  from  zero  or  7r. 

The  value  of  in  this  case  is  easily  computed  from  (10)  and  (25)  as 


*min-,;2  + (,-a*)JT- 


(39) 


The  approximation  arises  from  neglecting  summations  over  the  argument  of  nonstationary 
cosine  terms,  as  was  done  in  arriving  at  equation  (37). 


We  shall  now  compute  the  power  spectrum  of  r(k)  in  the  manner  of  equation  (23)  of 
the  preceding  section.  The  nonstationary  input  signal  (24)  may  be  dealt  with  by  assuming 
that  the  phase  0 of  the  sinusoid  is  a uniform  random  variable  on  [-ir,  7r] , thereby  resulting  in 
a stationary  sinusoidal  input  signal  with  autocorrelation  function 


*s(®)  = 


A2 

2 


COS  CUqC, 


(40) 


and  power  spectrum 


Ps(w)=— y [5(w-cj0)  + 6(w  + «o)J- 

The  only  effect  of  this  random  phase  assumption  on  the  ALE  output  is  to  convert  the  Wiener 
filtered  signal  output  to  a stationary  component.  From  (25),  we  obtain 


|HVW)|2 


aff IZI 

' L2  1 - 


cos  L(co  - ooq)  1 - cos  L(oo 


cos  (gj  - GJq)  1 - cos  (to 


+ ^q)~ 

+ W0>  / 


JT  < <*J  < JT, 

(42) 
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where  we  have  neglected  the  cross-product  of  positive-  and  negative-frequency  terms  in  the 
magnitude-squared  Fourier  transform  of  (25).  Substituting  (41 ) and  (42)  into  (23)  then 
yields 

7rA^  *2 

Pr(w)  = V—  (a*  + H £min  L)  [5(cj  - coQ)  + 5(w  + cog)]  + /*  £min  p2L 


, a*2y2  \lzl 

L2  U- 


- cos  L(o)  - ojq)  1 - cos  L(w  + cjq) 

7 T + 7 7 — 7 7 > - v < to  < jr. 

- cos  (cj  - COq)  1 - cos  (co  + COq) 


One  may  verify  that  this  expression  is  identical  to  that  obtained  by  direct  Fourier  transfor- 
mation of  (38a,  b)  with  the  input  signal  stationarity  assumption  discussed  above. 

As  described  in  the  previous  section,  the  delta  functions  in  (43)  arise  from  the  linear 
Filtering  of  the  input  sinusoid  by  the  WF  and  MF  weights,  the  white  noise  term  from  passing 
the  input  white  noise  through  the  MF  weights,  and  the  narrowband  noise  term  from  filtering 
the  input  white  noise  with  the  WF  weights.  The  relative  magnitudes  of  the  latter  two  terms 
as  a function  of  SNRjn  are  illustrated  in  figure  3.  Note  that  the  narrowband  output  noise 


SNRjn  = -50  dB 


-40  dB 


-35  dB 


Figure  3.  Plots  of  continuous  components  of  ALE  output  power  spectrum  as  a function 
of  SNRjn  (flat  portions  of  all  spectra  have  same  absolute  level);  L = 1024, 

linin' 4X  10-6.«o  = 05,r- 
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clearly  dominates  the  white  output  noise  as  SNRin  increases.  Since  this  white  noise  repre- 
sents the  bulk  of  the  misadjustment  noise,  these  plots  demonstrate  that  the  ALE  produces  a 
very  respectable  approximation  to  the  Wiener  filter,  with  no  a priori  knowledge  of  the  input 
statistics,  when  adequate  SNRjn  exists.  For  smaller  values  of  SNRjn,  the  attenuation  factor 

a*  in  the  WF  transfer  function  H*(ejw)  becomes  significant,  as  indicated  by  (42).  From  (27), 
we  observe  that  0 < a*  < 1,  and  a*  is  a nonlinear,  monotonically  increasing  function  of  the 
product  L • SNRin.  If  this  latter  quantity  does  not  greatly  exceed  unity,  then  a*  is  somewhat 

less  than  unity,  and  the  WF  transfer  function  is  attenuated.  This  result  is  a property  of 
finite-length  Wiener  filtering,  and  is  a consequence  of  the  minimum  error  power  criterion. 

The  finite-length  WF  can  reduce  the  narrowband  filtered  noise  power  within  the  filter  pass- 
band  only  by  reducing  the  magnitude  of  the  transfer  function  at  cjq-  This  simultaneously 

reduces  the  filtered  signal  amplitude,  thereby  increasing  the  error  power  resulting  from  in- 
complete signal  cancellation.  The  minimum  total  error  power  is  achieved  at  a compromise 
value  of  a*  (<  1 ),  and  this  can  significantly  affect  estimates  of  the  sinusoid  amplitude 
(obtained  by  spectrum  analysis  of  the  ALE  output)  when  SNRin  is  too  small.  Increasing  the 

filter  length  L will  narrow  the  filter  pass-band  about  the  center  frequency,-*  thus  improving 
the  estimate  of  signal  amplitude  for  a given  SNRjn.  To  illustrate  the  behavior  of  a*,  we  have 
plotted  in  figure  4 (solid  curve)  the  ratio 


- ut  . L ’ 

- **  'min  L 

as  a function  of  SNRin,  using  the  same  value  of  p £mjn  L as  in  figure  3.  This  curve  demon- 
strates both  the  nonlinear  behavior  of  a*,  and  the  relative  magnitudes  of  the  WF  and  MF 
sinusoidal  output  components,  as  functions  of  SNRjn.  Note  that  for  SNRjn  greater  than 

-35  dB,  most  of  the  sinusoidal  output  power  is  due  to  the  WF  signal  output,  but  SNRjn  must 
be  greater  than  -20  dB  in  order  to  obtain  a reasonable  amplitude  estimate. 

As  a final  illustration  of  the  results  in  the  example,  it  is  interesting  to  examine  the 
gain  of  the  ALE  as  a function  of  SNRin.  The  output  SNR  of  the  ALE  may  be  obtained  from 

(30)  and  (38a)  by  setting  £ = 0,  yielding 

*2 

a SNRin 


^ + M Un  LO  ^NR*) 


The  ALE  gain  G (in  dB)  is  defined  by 
G A SNRout  - SNRin  (dB), 


3 Increasing  L alto  raises  the  misadfustment  noise  level,  but  this  can  be  compensated  by  decreasing  u.  te.,  lengthening  the 
Initial  convergence  time.  For  a steady-state  analysis,  this  latter  time  is  unimportant. 
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r ~-.fr/ 


Figure  4.  Ratio  of  WF  to  MF  sinusoidal  output  powers;  solid  curve  given  by  (44);  see 
appendix  for  explanation  of  dotted  curve;  L = 1024,  ji£  mjn  = 4 X 10"^. 

and  is  plotted  in  figure  5 (solid  curve),  using  the  same  values  of  ti  £mjn  and  L as  in  figure  3. 
Note  that  for  very  low  values  of  SNRjn,  the  quantity  a*^  in  (45)  is  near  zero,  resulting  in 

negative  gain.  Physically  speaking,  the  MF  output  dominates  the  WF  signal  output  in  this 
range,  as  shown  in  figure  3.  As  SNRjn  increases,  the  gain  becomes  positive,  reaching  a peak 

value  of  approximately  22  dB,  and  then  drops  steadily  with  increasing  SNRjn.  This  behavior 

is  obvious  from  (45),  since  SNRout  approaches  a limiting  value  of  0*  £mjn  L)“*  as  SNRjn 

-*■  °°.  This  limiting  value  of  SNRout  is  due  to  the  unavoidable  misadjustment  noise  of  the 

ALE.  Observe,  however,  the  wide  and  useful  range  of  SNRjn  over  which  the  ALE  gain  is 
positive. 

6 DISCUSSION  AND  APPLICATIONS 

The  primary  significance  of  our  results  is  their  general  applicability  to  arbitrary  nar- 
rowband input  components;  i.e.,  one  need  not  go  through  the  tedious  analysis  required  to 
directly  compute  the  second-order  output  statistics  of  the  ALE  for  each  narrowband  signal 
model  of  interest.  The  burden  of  the  analysis  is  now  placed  on  finding  the  Wiener  filter  solu- 
tion for  the  problem  at  hand.  This  is  generally  an  easier  problem,  and  is  in  any  event  a pre- 
requisite for  the  direct  method  of  computation.  Once  this  is  obtained,  one  may  then  write 
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down  ipr(fi)  and  Pr(co)  virtually  by  inspection,  using  equations  (18a,  b)  and  (23).  The  cases 

for  which  the  Wiener  filter  solution  has  been  obtained  include  multiple  sinusoids  in  white 
noise  [3]  and  a class  of  narrowband  random  signals  in  white  noise  [9] . 

Applications  of  the  ALE  for  which  our  results  will  be  useful  include  narrowband  sig- 
nal detection  and  encoding  of  noisy  sources.  In  both  applications,  the  ALE  might  be  used  in 
a prefiltering  role,  and  hence  the  output  power  spectrum  is  of  key  importance  to  the  further 
analysis  of  such  systems.  Forthcoming  papers  will  discuss  these  problems  in  greater  detail. 


7 CONCLUSION 

The  steady-state  ALE  impulse  response  has  been  modeled  as  the  sum  of  two  parallel 
impulse  responses,  one  of  them  being  the  optimum  finite-lag  Wiener  filter  for  the  narrowband 
input  components,  and  the  other  being  a misadjustment  noise  filter  with  random  impulse 
response  coefficients.  The  outputs  of  these  parallel  channels  are  uncorrelated.  Using  this 
model,  we  have  derived  general  expressions  for  the  ALE  output  autocorrelation  function  and 
power  spectrum  for  an  input  consisting  of  narrowband  signals  in  white  noise.  An  example  is 
given  for  the  case  of  a single  sinusoid  in  white  noise.  These  results  are  useful  in  a number  of 
ALE  applications,  including  narrowband  signal  detection  and  noisy-source  encoding. 
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APPENDIX 


This  appendix  demonstrates  the  effect  on  the  ALE  output  statistics  of  using  the  more 
precise  weight  covariance  expression  in  [4] , viz., 


cov  { w(k)|  = fminI  + - 4>s  , 


(*) 


1 + Hr  SNR 


(A.l) 


in  place  of  (9),  for  the  sinusoid  in  white  noise  input.  Here,  4>s  is  the  signal  autocorrelation 
matrix  with  elements 


r i 

rsJip=T cos  w°  (i'p)> 

as  in  (40).  Thus,  from  (A.l)  we  have 


fi  »P} 


= M imin  S(i-P)  + 


txA* 


u 1 cos  wo  (i‘p) 


2 [l  +(y)  SNRj 


(A.2) 


(A.3) 


Substituting  (A.3)  into  (16)  and  simplifying  the  resulting  expression  gives 

k4L2 


*(«)  * < 


^ ^min  H 


rA2 


cos 


fi  p2A2 


MtM 


9 1 fiA^Lr 

+ + -f  7T\ — i 

j 8[lt(|)sNR] 


(L-iei)  cos  w0C,  |Ci  < L-I, 


COS  I0g2 


LA2  + MA4L2 

i 1 

k 

^ *min  + r / L \ 

. 8 ['  *(t)H. 

cos  cu0C,  |S|  > L, 


(A.4) 


(A.5) 


as  the  MF  output  autocorrelation.  Note  that  the  first  term  in  (A.4)  above  is  identical  to  (37). 
The  second  term  represents  an  additional  sinusoidal  noise  component  in  the  MF  output, 
while  the  last  term  represents  a narrowband  noise  component  having  the  same  autocorrela- 
tion function  form  as  the  narrowband  WF  output  noise  [compare  with  (34a)] . 


In  order  to  illustrate  the  relative  magnitudes  of  these  additional  terms  in  the  ALE 
output  noise,  we  define  two  ratios  Rg  and  RNB  as  follows.  Rg  is  the  ratio  of  the  power  of 

the  first  sinusoidal  noise  term  in  (A.4)  to  that  of  the  additional  sinusoidal  noise  term  which 


results  from  using  (A.  1 ) in  place  of  (9).  Rj^jg  is  the  ratio  of  the  power  of  the  WF  narrowband 

noise  output  to  that  of  the  additional  narrowband  noise  term  in  the  MF  output.  Then  from 
(A.4)  and  (38a),  we  have 

r6=J.  +(l-a*)SNRin,  (A.5) 


RNB~ 


(A.6) 


Since  p £min  L •<  1 in  practical  applications,  the  latter  ratio  will  greatly  exceed  unity  over  all 
the  useful  range  of  SNRjn.  Thus  the  additional  narrowband  term  resulting  from  (A.  1 ) is  of 
virtually  no  consequence.  The  ratio  Rg  is  infinite  when  SNRjn  equals  zero  (since  a*  is  then 
zero),  and  it  decreases  monotonically  to  a value  of  unity  as  a*  -*■  1 (SNRjn  -»  oo).  Thus  the 

power  in  the  additional  sinusoidal  noise  term  asymptotically  approaches  that  of  the  first 
sinusoidal  noise  term  for  large  enough  values  of  SNRin.  This  will  reduce  the  ordinates  of 
figures  4 and  5 by  the  amount 

- 1010*10  ('  *57)  ■ 

with  a maximum  reduction  of -3.01  dB,  as  shown  by  the  dotted  curves  in  these  figures.  Al- 
though nonnegligible,  the  influence  of  this  additional  noise  term  is  primarily  in  the  high-gain 
region  of  the  ALE,  where  both  output  sinusoidal  noise  terms  are  dwarfed  by  the  sinusoidal 
signal  output. 


In  summary,  the  intent  of  this  appendix  has  been  to  show  that  the  more  precise 
weight  covariance  expression  in  [41  for  the  sinusoid  in  white  noise  output  effects  only  minor 
modifications  to  the  results  obtained  by  using  (9).  Since  (9)  is  applicable  to  more  general 
inputs  (for  which  the  derivation  in  [4]  would  be  intractable),  we  consider  its  use  in  our 
analysis  to  be  justified. 
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